Web Survey Bibliography
In the last six years I have led projects aimed at developing software that learns how to code open-ended survey data from data manually coded by humans. These projects have led to the development of software now in operation at the Customer Satisfaction division of a large international banking group, and now integrated into a major software platform for the management of open-ended survey data. This software, which can code data at a rate of tens of�thousands of responses per hour, is the result of contributions from different fields of computer science, including Information Retrieval, Machine Learning, Computational Linguistics, and Opinion Mining. In this talk I will discuss the basic philosophy underlying this software, I will present the results of experiments we have run on several datasets of respondent data in which we compare the accuracy of the software against the accuracy of human coders, and I will argue for a notion of "accuracy" defined in terms of inter-coder agreement rates. Finally, I will discuss the kind of characteristics that make a survey more or less amenable to automated coding by means of our system.
Homepage (abstract)/(presentation)
Web survey bibliography - Italy (57)
- Anticipated estimation from a panel Web survey: the case of the presence of tourists in the Province...; 2009; Scaffai, G., Pratesi, M.
- The Electronic Questionnaire Experience in Business Surveys: mode effects on quality and on response...; 2009; Biffignandi, S., Siesto, G., Zeli, A.
- The new IT environment for the Italian consumer price survey; 2009; Giannini, R., Polidoro, F., Sgamba, A. M., Silipo, M., Spagnuolo, F., Virgillito, A.
- Is data collection via web a valid methodology?; 2008; Otero, P.
- Machines that Learn how to Code Open-Ended Survey Data: Underlying Principles, Experimental Data, and...; 2008; Sebastiani, F.
- Avoiding Massive Automated Voting in Internet Polls ; 2008; Basso, A., Miraglia, M.
- The Transition from University to Work: Web Survey Process Quality; 2006; Quintano, C., Castellano, R., D'Agostino, A.